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ABSTRACT 

Project RETAIN (Retention in Education Technical 
Assistance and Information Network) is a Florida project to assist 
school districts through identification and dissemination of 
effective practices that keep students with mild disabilities in 
school. One part of the project attempted to establish a consensus 
among experts in the fields of transition, special education, and 
dropout prevent i on on ef f ect ive practices wi th this population . A 
three-round Delphi procedure was used to elicit the opinions of 10 
national experts in four domains — organizational, programming, 
personnel, and social. A total of 180 effective practices were 
identified and grouped into 10 thematic areas. Panelists were also 
asked to rank the feasibility of identified practices. The experts 
agreed that good programs to prevent students with mild disabilities 
from dropping out should be realistic, student-centered, and 
flexible; provide wrap-around services; set limitations for which 
students and personnel are accountable; tie into real world demands; 
offer a place where students feel they belong and are wanted; 
encourage professional development; provide supportive 
administrators; foster intra-and interagency collaboration and 
cooperation; and view students hoi i s t i cal ly . Low feasibility ratings 
were given to practices considered valid but which involved major 
changes in belief systems or school systems. (Contains 27 
references . ) (DB) 
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Preface 



Project RETAIN: Retention in Education Technical Assistance and Information 
Network was developed in response to a Florida Department of Education, Bureau of 
Education for Exceptional Students request for proposal entitled IDEA, Part B. t Special 
Project, 1992-93: Using Career Preparation as Proactive Dropout Prevention for Students 
with Mild Disabilities. Funding was awarded to Florida Network: Information and 
Services for Adolescents and Adults with Special Needs, housed in the Department of 
Special Education at the University of Florida, to administer Project RETAIN. The 
mission of Project RETAIN is to assist school districts in providing appropriate 
programming to individuals with mild disabilities through identification and dissemination 
of effective practices that keep students in school to prepare them for postsecondary 
employment, further education, or training. 

The project is designed to identify effective practices that prepare students with mild 
disabilities for postsecondary employment an J education and to reduce the number of 
students with mild disabilities in Florida who drop out of school. Research to identify 
effective practices has been conducted through: 

1 . Identification of district needs and concerns. 

2. Development of a database reflective of dropout prevention programs across 
Florida. 

3. Identification of effective pnctices in dropout prevention and criteria for 
measuring these practices. 

4. Identification of programs that exemplify the identified effective practices. 



Project RETAIN has been meeting the technical assistance needs of district 
personnel, families, and service providers in the replication of the identified effective 
practices through: 

1 . Inclusion of project information in each issue of Florida Network News. 

2. Publication of a series of monographs covering identified effective practices, 
exemplary programs and practices, and resources for postsecondary students 
who are learning disabled. 

3. Dissemination of resources through a resource center that provides individual 
technical assistance, referrals to peer consultants, and development of technical 
assistance information packets. 

4. Sponsorship of regional training sessions highlighting identified exemplary 
programs and effective practices. 

This monograph is the first in a series of three monographs to be disseminated by 
Project RETAIN. Results of this study. The Relationship Between Dropout Prevention 
and Transition for Secondary School Students with Mild Disabilities, are reported in this 
monograph. This consensus-building study was conducted on a national level and 
included participants who are professional leaders in the fields of transition, special 
education, and dropout prevention. 
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Introduction 



"We must change tie way we do business in education... 

because business is depending on it. 
In fact, our entire economic survival is depending on it." 

Betty Castor, Florida Commissioner of Education 

Responding to high dropout rates and poor worker skills impacting slate and 
national economies, many states are implementing initiatives to reform education within 
their jurisdictions. State initiatives driving educational change in Florida include the 
Blueprint for Career Preparation and Blueprint 2000: A System of School Improvement 
and Accountability. The Blueprint for Career Preparation has three goals: (a) to close the 
gap between job requirements and the skills of Florida's work force, (b) to prepare 
students to work in a global and ever-changing marketplace, and (c) to enable graduates to 
get a job (Florida Department of Education, 1991). Blueprint 2000: A System of School 
Improvement and Accountability focuses on developing a system for school-based 
management that holds schools accountable for student learning. One of the seven goals of 
the school improvement initiative addresses graduation rates and student readiness for 
further education, employment, and training (Florida Department of Education, 1992). 
Both of these state initiatives require schools to evaluate their programming to ensure that 
they keep students in school and prepare their students for the future. These two 
educational initiatives go beyond making students fit the system by evaluating ways that 
schools can change to meet the needs of the students. Such an atmosphere of change offers 
an opportunity to impact school programming in ways thought unrealistic only a decade 
ago. For example, school systems can provide flexible schedules that allow students to 
help support their families by working while they attend school. 



One population often overlooked in educational reform includes students with mild 
disabilities who are at risk of exiting school without graduating. The current climate of 
educational reform offers the opportunity for the identification of effective practices that 
maintain these students in school and prepare them for work or further education. 
Identification of these effective practices would assist in providing schools direction for 
changing programming to meet the needs of this population. This report discusses a study 
that identified effective.practices for students with mild disabilities at risk of dropping out 
of school. These practices were developed as a me^-is to keep these students in school to 
prepare them for further education, work, and community life. The following sections 
focus on demographic characteristics of dropouts, leasons students give for dropping out, 
and dropout prevention programs. The merger of transition, special education, and 
dropout prevention to maintain students with special needs in school is also discussed. 

Dropout Demographics 

Early research in dropout prevention focused on identifying demographic 
characteristics of students who drop out. Socioeconomic background is one of the 
strongest predictors of early school withdrawal; students from low socioeconomic status 
homes are the most likely to drop out Gender and ethnicity are also related factors. Males 
are more likely to drop out than females, and students from minority homes — especially 
where English is a second language — are more likely to drop out than their non-minority 
peers (Fine & Zane, 1989). Finally, data from High School and Beyond (HS&B) indicate 
dropouts frequently attend urban schools in the south or west (Ekstrom, Goertz, Pollack, 
& Rock, 1986). 

Research also indicates similarities in dropouts' school experiences, with low 
achievement and discipline problems being major determinants of dropping out (Ekstrom et 
al., 1986). Low grades, retention, and poor performance on minimum competency tests 
are all associated with failure to complete high school (Hahn, 1987; Kreitzer, Madaus, & 
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Haney, 1989). Hence, efforts to raise achievement levels in school may function to 
exacerbate the dropout problem by adversely affecting at-risk students in ways that push 
these students out of the educational system (Quinn, 1991), 

The majority of dropout research has focused on dropouts from the general at-risk 
population while little attention has been given to students with mild disabilities who drop 
out. Yet statistics indicate that students with disabilities drop out at disproportionate rates, 
regardless of whether they are mainstreamed or in special-needs education (Butler-Nalin & 
Padilla, 1989; Wolman, Bruininks, & Thurlow, 1989). Furthermore, students with mild 
disabilities, especially learning disabilities and emotional disturbances, constitute the 
greatest proportion of special-needs students who drop out (Edgar, 1987; Wolman et al., 
1989). Reported dropout rates for students with specific learning disabilities are almost 
twice the dropout rate of their nondisabled peers (deBettencourt, Zigmond, & Thornton, 
1989). In Florida, reported dropout rates for students exiting school systems without 
diplomas or certificates of completion in 1988-89 was 78% for students with emotional 
handicaps, 54% for students with specific learning disabilities, and 41$ for students 
identified as educable mentally retarded (Beech, 199 i ). In addition, a "dropout cycle" for 
students with mild disabilities has been theorized based on data which indicates that 74<# of 
students with mild disabilities who left school return within one year, and 12% of students 
graduating interrupt their education at least once (Blackorby, Edgar, & Kortering, 199 1 ). 

Studies show employment ranges from 48% to 74% for individuals with mild 
disabilities who graduate from school. In contrast, students with mild disabilities who did 
not graduate experience employment rates ranging from 28% to 44% (Edgar, 1987; 
Zigmond & Thornton,. 1985). These data indicate that maintaining individuals with mild 
disabilities in school until they graduate can positively affect their chances of being 
employed. 
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Reasons Students Drop Out 

While research identifying common characteristics of dropouts has been helpful in 
identifying those most at risk of early withdrawal, more recent research has focused on the 
processes students go through in deciding to remove themselves from the educational 
system. Based on reasons students in the HS&B data set gave for early withdrawal, 
dropouts on the whole reported not liking school and having poor grades. Nearly one-third 
of the females in the study reported dropping out to get married while approximately one- 
fourth of the females reported dropping out because of pregnancy. Males on the other hand 
tended to report dropping out for economic reasons (i.e., they were offered a job or 
needed to help support their families), not getting along with teachers, and expulsion 
(Ekstrom et al., 1986). In a Florida study, some individuals with disabilities who left 
school without graduating indicated they dropped out of school because of general 
dissatisfaction and the stigma of being in special education (Florida Department of 
Education, 1990). 

Dropout Prevention Strategies 

Students matching the above profiles are targeted as being at risk of dropping out 
and are frequently placed in special alternative programs. These alternative programs range 
in the extent of their intervention. At-risk students may remain in traditional classrooms 
where they are monitored more closely than their peers while other programs allow 
students to attend special classes housed in the traditional school building. A third 
approach places students in a separate school with a specialized program geared to meeting 
the at-risk students' needs. While much research has focused on identifying characteristics 
common to dropouts, less attention has been given to effective strategies for retaining at- 
risk students to graduation. Four areas common to effective programs for students at risk 
of dropping out include: 
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1. Program organization and administration is small with high degrees of 
flexibility and autonomy. 

2. Teachers hold to a high degree of professional accountability and efficacy 
while addressing the students' social as well as academic needs. 

3. Students have a strong sense of belonging; strong student support structures 
as well as cooperative learning are common. 

4. Curriculum and instruction are often individualized an^ experimental, 
frequently utilizing community components such as internships. (Wehla^c, 
1983) 

Transition Dropout Prevention Strategies 

Researchers and policy developers, searching for methods to retain students with 
mild disabilities in school, have begun to merge the fields of transition, special education, 
and dropout prevention. Preliminary research has already taken place in this attempt to 
merge the disciplines. One proposed model used transition to maintain students with 
special needs in postsecondary vocational education programs and provide a " person- 
environment fit" (Brown & Kayser, 1985). In another research study, a survey was 
distributed to directors of exemplary vocational programs to collect information on 
components that made their programs strong (Batsche, 1985). Data from the survey 
indicated that effective practices include: (a) preservice and inservice education that 
addresses dropout prevention, (b) curriculum activities that develop self-concept, increase 
motivation, and refine daily living skills, (c) vocational and academic skills that are taught 
in realistic settings, ( fi counseling services that are available to students, (e) behavioral role 
models, (f) teachers who are perceived as approachable, and (g) additional research to 
determine possible discrepancies between teacher and student perceptions of the effective 
practices. 
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A statewide study in Florida to identify components of effective transition programs 
was also conducted (Rollins, 1989), The results of this study incorporate some of the 
same concepts as Batsche's effective practices and include: (a) interagency agreements, (b) 
functional curriculum, (c) individualized planning, (d) community-based training, and (e) 
support services. 

These preliminary studies indicate a need for additional research in effective 
practices for transition and dropout prevention. The need for research identifying effective 
intervention practices for students with mild disabilities is further supported by Blackorby 
et aL (1991) when they suggested the differences between students with disabilities who 
graduate and those who drop out lie more in educational practices and environmental 
factors than individual differences. In addition, Wolman et al. (1989) reported a lack of 
systematic research in identifying effective intervention strategies for reducing the numbers 
of students with disabilities who drop out. Clearly, research in the area of school practices 
that either increase or decrease a school's holding power is needed to provide greater 
insight into the dropout phenomenon. 
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Rationale for Study 



Most researchers have addressed dropout prevention f or at-risk students while few 
have addressed dropout prevention for students with special needs, especially individuals 
with mild disabilities, who are dropping out of school at alarming rates (Butler-Nalin & 
Padilia, 1989; Wagner, 1989). Additionally, researchers have identified effective practices 
for facilitating the transition of students with disabilities to postsecondary employment, 
education, and community integration (Clark & Kolstoe, 1990). Merging the research 
implications in special education, transition, and dropout prevention might identify effective 
practices thai prepare students with mild disabilities for postsecondary employment and 
education and reduce the number of students who drop out. 

The purpose of this study was to establish a consensus among experts in the fields 
of transition, special education, and dropout prevention regarding the relationship between 
dropout prevention and transition practices for youths and adults with mild disabilities. 
The results of this study allow conclusions to be drawn concerning the appropriateness of 
applying identified effective transition practices for students with mild disabilities to 
decrease the numbers of these students who drop out. This study sought to answer the 
following research question: 

To what extent are effective dropout prevention and transition 
practices for youth with mild disabilities the same? 



Methodology 



Conceptualization 

The consensus-building process used in this study was based on the Delphi 
Method, a method originally developed by Rand Corporation to effectively gather group 
information (Linstone & Turoff, 1975). Central to the Delphi Method is the belief that a 
group as a whole encompasses as much or more information, than any single member. This 
belief coincided with the conceptualization of this study — to gain a group consensus in 
response to the posed research question. There are three main factors associated with the 
Delphi procedure: (a) anonymity, (b) controlled feedback, and (c) statistical group 
response. Several properties of the Delphi Method made it attractive for this research 
project. First, it is an efficient way to gain information from a group of knowledgeable 
people. Second, the exercise can be highly motivating to respondents, thereby fostering 
novel and interesting responses. Third, the use of a systematic procedure provides 
objectivity to the outcomes. Finally, anonymity and group response allows a sharing of 
responsibility that releases the respondents from social inhibitions (Dalkey. Rourke. Lewis. 
& Snyder, 1972; Linstone & Turoff, 1975). 

The Delphi Method has other features that made it appropriate for this study. For 
example, funds do not need to be spent in bringing participants together for a series of 
meetings, making it a cost-effective research method. In addition, questionnaires take 
considerably less time to complete than attending a series of meetings, making this a time- 
effective process for participants. This method allowed experts from across the country to 
participate in the study. Further, it was anticipated that providing leaders with a research 
question through a process that eliminated peer influence would result in responses that 
were preeminent and thought provoking. This study, designed for 10 panel members, was 
especially appropriate for the Delphi Method because the method is effective for small, 
medium, or large groups (Linstone & Turoff, 1975). Finally, this method would allow 



generation of a statistically analyzed set of agreed-upon effective practices that represent the 
collective opinion and knowledge of experts across the country. 



Selection 

Literature searches were conducted in professional journals and Educational 
Resources Information Center (ERIC) documents in transition, special education, and 
dropout prevention to develop a pool of participants who are experts in these areas. The 
searches yielded a pool of 20 experts who have recently conducted research, implemented 
programs, published articles, or written books addressing dropout prevention for students 
with special needs. 

From this list, 10 experts representing a broad range of views were selected for this 
study's panel. Because the resulting data were to be used to identify exemplary programs 
within Florida, it was decided to limit the panelists to experts not currently working in 
Florida, thereby reducing bias. When more than one expert from a single institution was 
identified, the highest ranking position in that institution was selected. 

Eight of the 10 experts contacted agreed to participate in the study, and this created 
two open slots on the panel. One of the open slots represented a major research institute 
and was filled by requesting a replacement from within the institute. The second slot was 
filled from the previously identified expert pool. 



Survey Development 

Round 1 

Effective practices in transition and dropout prevention were identified from an 
initial review of literature related to dropout prevention for at-risk students and transition 
for students with disabilities. These practices were then merged into one list and organized 
into four domains: Organization, Programming, Personnel, and Social. The domains are 
representative of the previously mentioned four areas common to effective programs for 



students at risk of dropping out (Wehlage, 1983). Finally, possible models of the 
relationship between transition and dropout prevention for students with special needs were 
proposed. 

A survey based on these practices and models was developed and pilot tested. 
Feedback from the pilot testing indicated that the survey was too structured. Consequently, 
an open-ended questionnaire was developed that used only the original domains. Once the 
pilot test of the instrument indicated that the overall format of the open-ended questionnaire 
was effective, it was mailed to the 10 panelists. The panelists were directed to list at least 
10 practices and implementations in each of the four domains. A fifth area, Other, was 
included to allow for as broad an array of ideas as possible. Panelists were asked to list not 
only effective practices but also implementations of those practices to provide clarification 
of the identified effective practices. 

Domains 

The Round 1 survey was organized into four domains: Organization, 
Programming, Personnel, and Social. The domains chosen were representative of the four 
areas common to effective programs for students at risk of dropping out (Wehlage, 1983). 
This data organization continued throughout the study because effective practices identified 
and verified by the panelists fit within the following definitions. 

1 . Organization Domain: Practices that pertain to the structure and administration 
of the program such as scheduling, admittance procedures, and service 
coordination. 

2. Programming Domain: Practices that pertain to program development and 
content such as curriculum and instruction, student academic engagement, 
community-based training, and support services. 

3. Personnel Domain: Practices that pertain to each professional's perception of 
his opher role in the program such as collaboration, accountability, and goals. 

ERIC 1 5 



4. Social Domain: Practices that pertain to ea r * student's social needs in school 
and at the work place such as acceptance, n actions, social engagement, 
student recognition, and extracurricular activities. 

Round 2 

Responses from Round 1 yielded 362 practices and implementations. The practices 
were collapsed into 186 practices based on similar content within identified domains — 
except for practices listed under Other, which were moved at the researchers' discretion 
into the identified four domains. To increase reliability, ^ach researcher collapsed the data 
ihen compared the results. When disagreements occurred on collapsed items, discussion 
ensued until agreement was reached among the researchers. To ensure internal consistency 
in the Round 2 survey, the practices and implementations were edited for grammar and 
comparable sentence structure. After the survey was complete, an independent consultant 
compared the survey to the original data to ensure that information was not added or deleted 
from the intent of the panelists' Round 1 responses. 

During Round 2, the panelists were asked to rate only the 186 identified effective 
practices for validity and feasibility; implementations were used to clarify or illustrate the 
effective practices. Ratings in each area were done on five-point Likert scales, and the 
ratings were based on the validity and feasibility definitions provided in the Round 2 
mailing (see Table 1, page 13). The validity and feasibility definitions were modified 
according to previous Delphi studies (Jillson, 1975). Although the previous studies were 
not conducted in the field of education, it was felt that the definitions and rating scales were 
generic and would be applicable to education with limited modification. Since this study, a 
published educational study further supports using these rating scales (Feichtner, Apolloni, 
& Olivier, 1992). 
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Data Analysis 

Data were analyzed using Microsoft Excel 4.0 on a Macintosh Ilsi System. 
Statistical analysis of the data yielded percentage of response for each item on the i ikert 
scale, mode, and range for both validity and feasibility (Goldstein, 1975; Jillson, 1975). 
Because the purpose of the study was to gain consensus on effective practices for dropout 
prevention and transition for students .with mild disabilities, the term consensus needed to 
be operationalized. Consensus was defined to include the combination rating of numbers 1 
an d 2 — for each scale— that was greater than 60%. Consensus was gained on this validity 
scale on 180 practices. Of these 180 practices, 124 practices were rated as feasible. These 
effective practices were then rank ordered based on the percentages. 

Organization of Data 

Round 3 

To organize the 180 identified effective practices into a usable format, practices 
were placed into themes. The same method used in Round 2 to collapse data was used in 
Round 3. Practices were placed into themes based on similar content within identified 
themes. The themes were identified by the researchers based on a literature review and 
common trends that emerged under each domain. Each of the four domains — organization, 
programming, personnel, and social — contained common and unique themes. To increase 
reliability, each researcher organized data into themes and then compared the results. When 
disagreements on the organization of items occurred, discussion ensued until agreement 
was reached among the researchers. To ensure internal consistency in the Round 3 survey, 
an independent consultant reviewed the organization of practices under the themes within 
each domain. 

During Round 3, the panelists were asked to indicate their agreement on the 
placement of the practices under the themes within each domain. Placement verification of 
practices under themes was indicated through a survey sent to the panelists that, asked them 



to agree or disagree with the placement of the practices. If a panelist did not agree with the 
placement, he or she was asked to indicate a more appropriate placement for the practice. 

The panelists responding to Round 3 rated practices a* correctly or not correctly 
placed under a theme. Practices were considered as not h^ng placed under the correct 
theme within a domain if 60% of the panelists indicated disagreement with placement. The 
results of Round 3 indicate that 100% of the practices were placed under the correct theme. 
The return rate of 70% on Round 3 was lower than the other two rounds. This may have 
been due to the time that lapsed between Rounds 2 and 3. Because consensus was 
achieved in Round 2, this return rate does not affect the rating of the effective practices. 

Themes 

Practices were placed into 10 themes based on similar content. This data 
organization was necessary to show common trends within and across the domains. These 
common themes make the data more usable for program assessment and incorporation of 
practices into programs. The following list itemizes the themes and their definitions as well 
as specific content areas. 

1 . Climate 

Definition: Practices that aftect the atmosphere in which students learn. 
Content: Administration, school vision, individual student needs, cultural 
acceptance, professional growth, normative environment, high expectations, 
belief in success, rules and performance standards, accountability, extrinsic 
and intrinsic motivation, school community, and peer collaboration. 



23 

15 



Collaboration 

Definition: Practices that focus on partnerships as part of service delivery. 
Content: Interdepartmental collaboration, interagency collaboration, formal 
collaboration agreements, relationship with community, family and student 
participation, shared responsibility, articulated support services, and 
coursework. 
Evahiatioii/Development 

Definition: Practices that address program improvement. 
Content: Program evaluation and student monitoring. 
Individualization 

Definition: Practices that center on the individual needs of the student. 
Content: Personnel, parents, and students involved in IEP development; 
transition and dropout prevention; planning as pail of the IEP; social issues 
addressed in the IEP; future and career planning; case management; and 
assessment offered. 
Program Friendliness 

Definition: Practices that focus on methods to ensure programs meet the needs 
of students and are easy for students to access. 

Content: Admittance and re-admittance flexibility, support services, help for 
problems on demand, alternative programs, pregnant and parenting teens 
programs, active recruitment and outreach, policies to attract former students, 
equitable access to services and programs, flexible scheduling, peer support 
and recognition, social network of friends still in school, and sense of 
acceptance and belonging. 
Services 

Definition: Practices that address support services needed lo maintain students 
in school. 




Content: Youth advocacy, role models, mentors, embedded career services, 
wrap-around family support, comprehensive array of services, services to 
master course content, guidance and counseling, small group counseling, and 
on-site child care. 

7 . Instruction and Curriculum 

Definition: Practices that address components of teaching and impact 
curriculum design. 

Content: Empowerment of students, interrelated educational and vocational 
goals, flexibility and ability to adapt, interpersonal skills, community life, 
social skills, community-based training, sequence of learning, multiple 
instructional approaches, individualization and modification, relationship 
between work and life, and training and paid employment. 

8 . Student Objectives 

Definition: Practices that focus on the skills and qualities of students. 
Content: Conflict management, problem solving, goal setting, personal 
understanding of disability, self advocacy and referral, recreation and leisure 
skills, team building, school survival skills, accepting criticism and managing 
authority figures, safety skills, volunteerism, responsibility, study skills, basic 
skills instruction, and skill transfer. 

9 . Staff Qualifications 

Definition: Practices that focus on the skills and responsibilities of personnel 
who provide services to students. 

Content: Formative and summative accountability, job development, flexible 
service and instruction response- conflict resolution, users of research, 
behavior management, and success-oriented curriculum design. 
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10. Training 

Definition: Practices that address the provision of preservice and inservice 
programs. 

Content: Institution-wide personnel development plan; opportunities for 
educators and personnel from business, industry, and agencies are provided to 
observe and switch roles; and new personnel orientation and current personnel 
update . 

NOTE: A copy of the instruments for Rounds 1, 2, and 3 are available upon 
request from the Florida Network. 
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Results and Implications 

Rounds 1 and 2 yielded return rates of 100%; the responses were returned within a 
month from mailing the questionnaires. Six of the 10 panelists indicated that this was a 
difficult but worthwhile and thought-provoking process. Li Round 2, 100% of the 
panelists rated 186 items except for one item that one panelist neglected to rate. Only one 
panelist indicated that the researchers misinterpreted a response from Round 1. Although 
this item was rated by all panelists during Round 2, it was not used in the final data 
analysis. The high level of agreement on the Round 2 data indicated that the panelists 
reached consensus on 180 items. Round 3 yielded a 70% return rate. Data from Round 3 
indicated that the 180 identified practices were placed into the appropriate themes. 

The top six themes of the 180 effective practices across all the domains were 
Climate (26%), Collaboration (13%), Student Objectives (12%), Services (12<#K 
Instruction and Curriculum (12%), and Program Friendliness ( 11% ) (see Table 2. paize 
20). Eighty-six percent of the 180 effective dropout/transi ion practices generated by the 
panel address these six themes. This rating seems to be supported by both dropout 
prevention and transition effective practices listed in the literature such as administrative 
support, interdepartmental and interagency collaboration, availability of support services, 
functional curriculum, and addressing the student's individual social and academic needs 
(Batsche, 1985; Rollins, 1989; Wehlage, 1983). 
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Table 2 



Effective Practices by Themes and Domains 



Themes 


Organization 


Programming 


Personnel 


Social 


TOTAL 


Climate 


11 


10 


13 


12 


46 


Collaboration 


9 


6 


9 


0 


24 


Evaluation/ 
Development 


2 


0 


0 


0 


2 


Individualization 


a 
t> 


5 


I 


u 


y 


Program Friendliness 


9 


4 


0 


7 


20 


Services 


8 


6 


0 


7 


21 


Instruction and 
Curriculum 


0 


11 


0 


10 


21 


Student Objectives 


0 


4 


0 


18 


22 


Staff Qualifications 


0 


0 


10 


0 


10 


Training 


0 


0 


5 


0 


5 


TOTAL. 


42 


46 


38 


54 


180 



Validity 

The validity Likert scale offered the panelists five possible ratings with a rating of 1 
being the most valid and 5 the least valid (see Table 1, page 13). Validity factors rated 
included: (a) effectiveness of practice, (b) relevance to issues and concerns, (c) level of 
impact on issues and concerns, and (d) level of need to address. Practices were considered 
valid if 60% or mere of the panelists rated the practices with a 1 or 2 on the validity scale. 
Ninety-seven percent of the 186 practices included in Round 2 were rated as valid by the 
panel. 

Domains 

Discussion of the following domains is based on Round 2 data because consensus 
of identified practices was gained during Round 2. Therefore, these results are based on 
the 186 practices rated on the Round 2 questionnaire. 
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Organization Doinain 

The respondents were almost unanimous in thinking that the listed Organization 
Domain effective practices were valid. Ninety-five percent of the original 44 items were 
scored as being valid based on the definition of consensus used in this study (see Table 3, 
page 22). The Organization Domain effective practices fall into six themes including: (a) 
Climate, (b) Collaboration, (c) Evaluation/Development, (d) Individualization, (e) Program 
Friendliness, and (0 Services. The Evaluation/Development theme is unique to the 
Organization Domain, a logical place because this centers on practices impacting school 
structure and organization. Effective practices in this domain focus on involving 
administrators, providing student-centered services, evaluating programs, setting a positive 
school climate, establishing interdepartmental collaboration, coordinating interagency 
collaboration, encouraging community involvement, supporting youth advocacy, 
formalizing case management, facilitating program re-entry, and providing support. These 
practices offer a structure to "support students and personnel as well as the programs 
developed for students with mild disabilities. 
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Programming Domain 

The panelists agreed that 96% <>f the Programming Domain effective practices were 
valid (see Table 4, page 25). The two themes unique to the Programming and Social 
dc~ ;ains are Instruction and Curriculum and Student Objectives. This is not surprising in 
domains that address effective practices related to providing programming to students with 
mild disabilities to maintain them in the school setting. Practices that were rated as effective 
in the Programming Domain center on establishing and communicating performance 
standards; focusing on student strengths; sharing responsibility for programming; 
integrating academics, vocational experiences and support services; using multiple 
instructional approaches; offering flexible scheduling; focusing on social skills 
development; and teaching students to learn how to learn. These are practices that teachers, 
curriculum specialists, and other personnel can infuse into the curriculum to impact 
students. 

Personnel Domain 

Ninety-five percent of the effective practices in the Personnel Domain were rated as 
valid by the panelists (see Table 5, page 28). This domain has two unique themes: Staff 
Qualifications and Training. The Personnel Domain relates to the roles professionals play 
in the provision of services to students with mild disabilities at risk of dropping out. 
Therefore, it is appropriate that these two themes centering on personnel preparation and 
needed skills are listed in the Personnel Domain. Practices that the panelists rated as 
effective under the Personnel Domain include mentoring and counseling students, 
developing student rapport and trust, taking responsibility for student outcomes, sharing 
information with colleagues, practicing effective team building, developing individualized 
education plans (IEPs), using curriculum modification strategies, and establishing staff 
development programs. These are skills that personnel need to possess and use when 
working with students. 
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Social Domain 

One hundred percent of the Social Domain effective practices listed were rated as 
valid by the panelists (see Table 6, page 31). Two themes not represented in the Social 
Domain were Collaboration and Individualization. Practices centering on peer collaboration 
were more appropriately placed in the Program Friendliness theme. However, it is 
interesting to note that intra/interagency collaboration was not represented in the Social 
Domain as were practices related to student services. The nonrepresentation of the 
Individualization theme is perhaps due to the domain's focus on the social needs of 
students in school and in the work setting. Effective practices in the Social Domain include 
participating in all facets of the school community, receiving leadership and social skills 
training, learning interpersonal skills, developing social networks, and obtaining a full 
array of needed support services. These practices are student centered and directly related 
to student support and skill building. 

Feasibility 

The feasibility Likert scale offered the panelists five possible ratings with a rating of 
1 being the most feasible and 5 the least feasible (see Table 1, page 13). Feasibility factors 
rated include: (a) ease of implementation, (b) resource availability, (c) structure existence, 
(d) level of political roadblocks, (e) acceptance to the general public, and (f) cost benefits. 
Practices were considered feasible if 60% or more of the panelists rated the practices with a 
1 or 2 on the feasibility scale (see Table 7, page 34). Sixty-nine percent of the 180 
practices identified as valid were rated as feasible by the panel. 

Although consensus seemed to exist on the validity of the effective practices, the 
panelists did not reach as strong an agreement on the feasibility of implementing the 
practices. Only 53% of the practices in the Organization Domain were scored as feasible, 
whereas 95% were rated as valid (see Table 3, page 22). The panelists agreed that 96% of 

45 

30 



8 



G3 



0> 
> 



■a 

c 

13 



ERIC 



as 
'a 



«5 



8 

G3 



O 

a. 



8.1 



C/3 



c.2 

O .-3 

a & 

2-g 

.S 3 

2 3 

_"8 
•s g 

.2 
u 2 

£ ?? 

Z - 
c 

3 



< 



a 
£ 



8 



"8 



■c 



2 



J8 



S3 

Q. 

O 

-a 



i3 



8 



o 

CO 



t-. 

> 



£2 



•s 



"8 

at 

IS 



3 
a. 



1 



to 

8 

£2 
H 

o 



1 



3 

a 
o 

3 



1 



o 



2 

c 



5 
o 



JC 

u 

3 



Of 

e 



\> 
o 



I 

OQ 



o 
o 

I— 

oo 
UJ 
CQ 



o 



CD 



o 



-3 



X2 



31 



1> 



S3 

a. 



2 
5 

« 5 



ERLC 



§ 

c 
US 
T3 

> 

s 

Q. 



i 



at 

DC 



|T3 

£ 

o. 

I 

c 
-a 

3 

55 



o 



O 

cc 



> 



2 o 

titi o 

£ !2 
c ° 
£ o 



8 s 
Si 

"3 



3 



S 



■3 

S 



,2 S 



32 



8 



«8 



«2I 

rail 

CO 

C 

E 



s 



c 



8 



Q£ Oi 



8 



O 
00 



"8 

3 



O 
-3 



CD 

> 

>- 

CL, 
O 
O 

•— 

t/O 
UJ 
CQ 



•31 
c 
o 



c 



o 
•a 



■a 



js _ 

0JC| oi 



C 

o 

\3 
g 



jC 

oi oi 



3 



s 

Q. 



3 
oc 



•n 

o 

& 



3 



9h 

"3. 

6 

o 
u 



3 

2 



c 

1 

C/3 



"oi Di 



2 

c 



2 
c 

o 
3 



3 
c 



T3 
3 



c 



05 

a. 
> 

c 

"cn 
c 



















bili 


o 


o 


o 


Feasi 






















>- 
jS 


o 

oc 


§ 


§ 


Val 
















tuden 








CS3 








o 








<y 
















a 1 








s and 








skill 








the 








3 

O 








focus 








that 








ices 








— 

'act 








ex 








Tective 






Iopment 


tlnued). El 


ibilitv. 


or 

.s 


f skills deve 


;ctlvcs (conl 


icht resnonsi 


ovided leisu 


ovided stud} 


Oblc 


r, 

2 


are oi 


a. 


udent 


1 

= 


v 
' c 

; i 


ludents 








V3 



to 



o 



ERIC 



33 



the Programming Domain effective practices were valid and 79% were feasible (see Table 
4, page 25). Ninety-five percent of the effective practices in the Personnel Domain were 
rated as valid by the panelists, whereas only 50% of the practices were rated as feasible 
(see Table 5, page 28). One hundred percent of the Social Domain effective practices listed 
were rated as valid by the panelists, and 83% were rated as feasible (see Table 6, page 31). 



Table 7 

Percentage of Effective Practices by Theme and Domain Rated as Feasible 



Themes 


N 


n 


Organization 


n < 


Programming 


n 


Personnel 


n 


Social 


Climate 


46 


11 


73% 


"To" 


100% 


13 


46% 


12 


92% 


Collaboration 


24 


9 


78% 


6 


100% 


9 


56% 


0 




Evaluation/ 
Development 


2 


2 


'100% 


0 




0 




0 




Individualization 


9 


3 


67% 


5 


80% 


1 


100% 


0 




Program Friendliness 


20 


9 


22% 


4 


50% 


0 




7 


57% 


Services 


21 


8 


13% 


6 


67% 


0 




7 


100% 


Instruction and 
Curriculum 


21 


0 




11 


73% 


0 




10 


100% 


Student Objectives 


22 


0 




4 


75% 


0 




18 


72% 


Staff Qualifications 


10 


0 




0 




10 


67% 


0 




Training 


5 


0 




0 




5 


80% 


0 




TOTAL 


180 


42 




46 




38 




54 





N=total number of effective practices under theme 

n=total number of effective practices under theme in each domain 



Least Feasible 

Themes with 60% or more of the effective practices rated as not feasible by 60% or 
more of the panelists include: (a) Organization Domain — Program Friendliness and 
Services, (b) Programming Domain — Program Friendliness, (c) Personnel Domain — 
Climate and Collaboration, and (d) Social Domain — Program Friendliness. In all domains, 
60% or less of the identified Program Friendliness effective practices were rated as 
feasible. This pattern of rating Program Friendliness seems to indicate that these practices 
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are valid and important but difficult to implement. Effective practices under this theme 
address areas such as re-entering into programs, flexible scheduling to meet the individual 
needs of students, and fostering a sense of acceptance and belonging. The identified 
effective practices under the themes of Climate and Collaboration in the Personnel Domain 
were also rated as valid but not feasible by 60% or more of the panelists. These practices 
address two main areas: (a) teachers' commitment to change regarding themselves, the 
community, collaboration, and students, and (b) teacher accountability for student 
outcomes. Effective practices addressing Climate and Collaboration are perhaps easily 
implemented in other domains not dealing with personnel concerns. Effective practices 
dealing with personnel issues are perhaps more difficult to mandate and evaluate. 

Most Feasible 

Practices that 100% of the panelists rated as being feasible are included under: (a) 
Programming Domain— Climate, (b) Social Domain— Climate, (c) Programming 
Domain — Collaboration, (d) Organization Domain — Evaluation and Development, (e) 
Personnel Domain-Individualization, (f) Social Domain— Services, and (g) Social 
Domain — Instruction and Curriculum. Effective practices listed under these themes center 
on providing students with opportunities to interact with other students and to achieve 
success. Additionally, these themes address setting high student expectations, providing 
extracurricular activities, offering students realistic education and training, and fostering 
interdiscipl ; ne and interdepartmental collaboration. 

The difference between the least and most feasible practices seems to be that of 
controllable and noncontrollable factors. The least feasible practices center on attributes 
that teachers and students should possess or that the school system should assist them in 
acquiring. However, these practices may carry with them political roadblocks and may not 
be within the school systems' available resources to offer. An example is teacher 
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accountability for student outcomes. This is a valid practice but difficult to monitor and 
politically unpopular with some teachers and administrators. 

Conversely, the most feasible practices are those that the school system can offer to 
foster skill acquisition. For example, setting high student expectations can be implemented 
with existing school resources and is acceptable to the general public. This may indicate 
that the panelists were differentiating between those practices that school systems can offer 
and those practices that are valid but that systems can only hope to foster. Program re- 
entry and schedule flexibility are exceptions to this conclusion. An explanation for the 
rating of least feasible given is that these practices may be difficult to implement within 
existing school structures. 
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Summary 



Based on the results of this study, programs designed to prevent students with mild 
disabilities from dropping out and prepare them for community life seeia to have some 
common components. These common components suggest that good programs are 
realistic, student-centered, and flexible; provide wrap-around services; set limitations for 
which students and personnel are accountable; tie into real world demands; offer a place 
where students feel they belong and are wanted; encourage professional development; 
provide supportive administrators; foster intra- and interagency collaboration and 
cooperation; and view students holistically. 

The panelists quickly reached consensus on practices that they considered effective. 
Based on their reading and research, they indicated they were confident that a set of 
common effective practices existed. Interestingly, the panelists were also able to come to 
consensus readily on practices that were valid but not feasible. The pattern of practices 
considered as not feasible suggests that the panelists were pessimistic that school systems 
would be able implement the practices that were considered valid. This pessimism centered 
on practices that involved personal belief systems, changes in personnel, and large-scale 
school system changes. Therefore, the panelists' low feasibility ratings in some areas may 
have been reflective of the reality of the difficulty systems will have in implementing and 
monitoring the incorporation of the practices into programs. 

The word "change" has almost become synonymous with the American school 
system. This change is a reaction to the changing needs of students and society. Students 
with mild disabilities have many opportunities available to them in the work place, but they 
also have obstacles to overcome so that they can receive the training needed to take 
advantage of these opportunities. As school systems change to accommodate and provide 
for the growing diversity in the school population, the timing is right to incorporate these 
identified effective practices. These practices need to be considered and further researched 
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as systems restructure their administrations, programming, personnel expectations, and 
student outcomes. 

Further research is planned through Project RETAIN to assist school systems to 
incorporate these practices into their programs. This research will identify current 
programs that are incorporating these effective practices in their programs to serve as 
models for replication. A second monograph will be written describing these programs. In 
addition, training is scheduled to share these practices and provide program examples for 
replication. 
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